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ABSTRACT 



This paper presents an R 6 D planning systen (RDPS) 
that consists of (1) a aultistage nodel for fornulating projects and 
(2) a ••reward'^ nodel for selecting projects* The systen is based on a 
conbination of decisionnaking and operations research approaches* 
Using the systen concept, the R 6 D process is defined in three 
interrelated terns — Aission, goals, and objectives — that serve as 
the radix for generating projects in nultistages* The project 
selection nodel is used t ; select projects that naxinize expected 
total **reuard*' within buagetary linitations* The proposed RDPS can be 
used to concentrate and coordinate research and developnent 
activities* (Author) 
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PREFACE 



The concept of research and development is a relatively recent 
addition to the field of education. Not too many years ago, most educa- 
tional research was carried out by Individual researchers from different 
fields of study, either working alone or in small teams. These raon 
identified problems, found a source of funding, a^'id then attempted to 
solve the problems they had identified. Over the years a great deal of 
research has been very successfully carried out in this manner. However, 
with the growing recognition of the magnitude of the problems facing those 
in education today, tho need for purposeful direction in research has be- 
come apparent. The funds available for research are not sufficient to 
support all the work that needs to be done. Thus, some system must be 
developed that will lead to an efficient and effective use of available 
resources . 

In subsuming a part of the educational research enterprise, research 
and development c^^nters were a response to the problem of the lack of inte- 
gration and direction in educational research. However, they have proven 
to be only a partial answer. They have moved toward the narrowing of re- 
search directions into manazeable cliannels, but *s yet they have not been 
aj successful in providing an integrative and additive affect for the re- 
search which has been produced. Recognizing thi.s problem Dr. Vivekananthan 
has developed a planning sy. oip for educational research and deve lopment 
which may help to overcome some of the present problems in research and 
development, and help the centers achieve their full potential. 

The Center would like to extend its appreciation to Dr. Vivekananthan 
tor developing the system, to Dr. Donald Drewes of North Carolina State 
University who provided consultation in the development of the planning 



sys'cein, aad to the following persons who reviewed the paper prior to its 
publication in the Center^s Occasional Paper Series; 

Dr, Charles V. Mercer, Associate Professor of Sociology and 
Anthropology, 

Mr, Robert L- Morgan, Research Assistant, Center for Occupational 
Education. 

Dr. Allen B, Moore, Visiting Assistant Professor, Division of 
Occupational Education. 

all of North Carolina State University. 

Ihe Center would also like to thank the Center staff for Its assist* 
ance in the production of this paper. Including Mcs. Mary King, Mrs, Ann 
Purtill and Mrs, Rosalie DeBrlto who were responsible for preparation of 
the final manuscript and Mrs. Sue Kills who arranged for Its reproduction. 

This paper wa£< also presented at the 1971 annual meeting of the 
American Educational Research Ascoclatlon held In New York City, February, 
1971, 

John K, Coster 
Director 



SUMMARY 



This paper presents a R & D planning system (RDPS) that consists 
of (1) a multistage model for formulating projnete, and (2) a "reward” 
model for selecting projects. The system is b^sed upon a combination 
of deciaion-making and operations research approaches. Using the system 
concept, performance of the R 6e U process is de Lined in terms of thvee 
interrelated terms: mission, goals, and objectives. These serve as the 

radix for generating projects in multistages. The project selection 
model is used to select projects that maximize expected total "reward" 
within budgetary limitations. The proposed RPPS can be I’Sed to concen- 
trato and coordinate research and development activities. 
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INTRODUCTION 



Chase (1970) has indicated that the educ^itional R & D organiza^ 
tions have set themselves ”to provide educational agencies with care^ 
fully designed and tested products, processes, and systems appropriate 
to their goals and functions.'' A unified, integrated planning system can 
help the R & D organization to achieve this goal. The present paper is 
addressed to the development of such an overall planning system suited to 
educational R 6c 0 orgjsnizations, based on a mission-orieated approach. 

It should be emphasized that this is only one of many possible p? nning 
systems. (For a different approach, see Vivekananthan, 1971.) 

As generally used, the term "planning" refers to the development 
of a detailed method, formulated beforehand, for doing or making something, 
Plannfng thus implies a coordinated activity with a concentrated purpose. 
Planning also serves as a vehicle for controlling and directing activities. 

For our purpose, the planning system is defined as a enmprehensive 
operating scheme to cover R 6c D activities. The R 6c D planning system con* 
siots of (1) a procedure to systematize the formulation of projects, and 
(2) a project selection model to optimize the expected returns of k 6 D 
efforts within resourco corstraints. 

Baais for Formulation of Prolects 
The machinery for generation of educational R 6c D projects to be 
carried out by a center must be based on what the center is expected to 
perform. For this purpose the systems approach is very useful. 

The systems approach helps to view the research and development 
process as an entity and not simply as a combination of some research and 
some developmental activities. Research and development is thus considered 
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as a set of Interrelated processes for dealing with problecas. Coordi- 
nated efforts are required in solving the problems. The R & D process 
being defined as a sycteca has a clear-cut mission. Incorporation of 
this fundamental assumption is necessary for the development of the 
pLt^nning system. 

System performance has meaning In tne context of three mutual l;^ 
dependent verms: mission, goals, and objectives. M ission is the ulti- 

mate aim of the system, tnat is, what will have been accomplished at the 
end of the terminal phase. The system implements this ultimate purpose 
through a aeries of preliminary activities performed through time and 
phases. As such, the mission Is achieved through desired ourcomes over 
time and phases. Desired outcomes are the of the system. Those 

functions which assign utility (value) to outcoToes are termed criterion 
measures. Each goal la assumed to have measurable units. Objectives 
are defined as desired states of criterion measures of performance. 

They are precise and specific measures of goal.:. In other words ob- 
jectives are the desired outputs from the systec> needed tc. accomplish 
the goals. The ayatem outputs react with environmental states to pro- 
duce desired outcomes. The objectives Indicate the system perfocc&ance 
In measurable units and^ as such, they reveal how well the system is 
progressing towards attaining the goals. 

The three coacepts--ml88lcn, goal, and objective- -as they are 

defined, form the base from which projects can be formulated in multi- 

stages. At each stage a mis sion - pro f ile la drawn that tllustratea the 

major sequential activities, the profile la used to segment the mission. 

The segments are classifications of activities In the profile which are 

arbitrarily selected on the basis of both homogeneity of operations or 
O 
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coherence within the segment, and 'Easily i.ecogni2ed ftart and stop points. 
Once a trcsslon is stated clearly, the feasibility of segmenting the mis- 
sion can be explored. 

After segmenting a mission Into goals and the oals Into objectives 
at the first stage, one goal area serves as a mission for the second stage* 
The mission profile of the second stage aids In deriving the goals and ob- 
jectives of that stage, and Ideally the goals of th(* second stagf are the 
objectives which pertained to the goals of the first st.f»ge. The multi- 
stage transitional process Is depicted In Figure I, and Illustrated with 
an example In Figure 2. Stage I In Figure 2 may be viewed as a breakdown 
at the center level. The center mission Is broken down Into programs c^nd 
subprograms. Stage 2 can be considered as a breakdown of the programs. 

At stage 2, programs are broken down to iutprograms, and subprograms to 
sub-subprograms. At stage 3, the subprograms are broken down to sub- 
subprograms, and sub-subprograms to sub-sub-subprograms. The process Is 
continued until a convenient stage Is reached to formulate projects. 

Stage I Staste 2 Stt 3 

Mission ^Mission Ion 

4 , 4 . 4 

Goa Is Goa Is .Goals 

4 . /» 4 - /* 4 - 

Objectives Objectives' Objectives 

!/igure 1 '^ulti^stage*' Transitional Process 
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Stage I 

Center 

) 

V 

prois'rams 
. '1' 

subprograms 




Stagg 2 
programs 

4 

subprograms'' 

4 

sub -subprograms^ 



Stage 3 



Stage N 



i 



p 3ubpr^grams 

4 

sub -subprog rams 

I 1 

sub - sub -subprog rams projecti 



Figure 2 An Example of the Multi-stage Transitional Process 

One goal area of the second stage forms a mission to the third stage, 
one goal area of the third stage forms a mission for the fourth stage, and 
so on. The transitional process can be stopped at the most convenient stage. 
Following this procedure, ten objectives are arrived at in Figure 3. 





Figure 3 A Process of Deriving 10 Projects 
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Each of the objectives of the last stage forms a problem area for 
Investigation ard as such, an objective dictates formulation of a project. 

A project. In this sense, Incorporates one of the objectives as Its main 
theme of research. A project Is thus aimed to deal wlhh an objective. 

Vfho Formulates Prjiects ? 

The first problem to arise In the Implementation of the planning 
system Is who Is going to segment the mission. One of the most Interesting 
solutions to this problem comes from Bloom (1968); *'Thls writer (Bloom) 
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suspects that a theory must be foimulated by one person, preferably the 
leader of an R & D center, ano then altered as the result of heated debate 
by a group.” 

Afi alternative method Is the use of the Delphi technique (Helmer, 

1966), The Delphi procedure Is a method for systematically soliciting, 
collating and developl’^g a consenses of expert opinion. The Delphi method 
replaces direct confrontation between members of a declslon-maklng panel 
with a si?rles of questionnaires that feed back Information collected from 
the members. The questionnaires cover the members' statements and the 
reason for their statements. The information is kept anonymous and redis- 
tributed to the members who may then revise their statements In the light 
of the statements of others. The process is continued until a satisfactory 
consensus Is obtained. The Delphi method requires a declslon-maklng panel. 

The declslon-maklng panel can segment the mission to goals, and 
goals to objectives. The panel can use the following guidelines In stopping 
the multi-transitional process. 

When to Stop the Multl-Transltlon a l Process ? 

The multi-transitional process can be terminated at a c onvenient stage. 
The ^formation requirements of the system determine the convenience. Meehan's 
(1968) notion of scope, precision, power, and reliability can be used to de- 
termine the Information requirements in a statement of objectives. 

The scope of a statement of objectives indicates the range of infor- 
mation that the project will yield at the project's completion. If the scope 
Is too wide. It loosens the precision of Information In that It may be vague 
and auiblguous. Too broad a scope may trap many areas without a well-defined 
purpose of research. On the other h*:nd, too narrow a acope pro^^uces outcomes 
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which are minute and applicable to a very limited area, giving collected 
information that is very detailed but restrictive. The scope of the state- 
ment of objectives ought to be between the two ixtremes. 

The prec ision of a statement of objectives refers to the exactness 
with which the projected outcomes are related to real outcomes. It refers 
tc specificity and accuracy of information. The ruulti-transitional pro- 
cess is stopped as the objectives achieve the required precision level. 

Too precise information would reduce the scope; a broad scope would reduce 
the precision level. Decision makers have to decide or the trade-off 
between scope and precision level. 

Power bears upon the notion of relevance of the project outcomes 
to the goals. As such, power deals with how much control the objer^'lves 
would provide in integrating the information gleaned from the projects 
with the goals. A weak statement of objectives may do no more than sug- 
gest f.he relevance of the outcome of the project to the overall mission 
without stipulating the nature of t!ie outcome, while a strong statement 
of the objectives would readily show the relevancy stipulated in precisely 
measured terms. Powerful objectives would help to integrate project out- 
comes into attaining the overall mission of the Center. 

Reliabilit y has to do with repeatability in arriving at the objectives. 
Reliability, thus, deals with the question of ''Would the same set of objec- 
tives be generated if the transitional process is repeated again?*' The 
discrepancy between segmentations is revealed only by observation and 
ih..ultlve Judgment. Usually, ret i ability" can be increased by decreasing 
the precision of the statement of objectives. Reliability will be lower 
as the multl-tranaitlonal stages increase. In other words, a larger num- 
ber of stages would decrease reliability and a smaller nuo^ber of stages 
would increase reliability. 
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The multi-transitional process is stopped when the objectives have 
sufficient scope, the needed precision level, enough power to integrate, 
and when the transitional process has adeqvjate reliability. The number of 
objectives there ate at the last stage of tl^e transitional process wo'Jtd 
govern as many projects. After objectives are formed, project statements 
are written by interested Investigators, 

The investigators choose obje^txves relevant to their interests 
from the generated pool o^ objectives and write project statements Incor- 
porating the objectives of their choice. 

The investigator details in the project statement the methodology 
to be followed in attaining the stated objective. The methodology includes 
design of the investigation, statistical techniques, data collection method, 
and similar Information. The investigator also indicates the amount of 
time required to complete the project. He presents a schedule of activi- 
ties. Estimated expenditures are also listed In the project statement. 
Expenditure or data collection, field trips, data analysis (cost for com- 
puter us*), dnd other expenses are estimated by the Investigator. Each 
project statement will Include a budget to carry out the project. 

The multi-transitional process provides a rationale and justifica- 
tion for project formulations. Actually projects are formulated by the 
investigators. The multl-transltional process simply supplies objectives 
that investigators use In forr^ulatlng projects. In order to attain the 
stated mission, the projects have to be executed. Some projects may have 
more utility than others^ which lea^s to project celectlon process. 
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Pro,^ect Selection Model 

Since the resources available may not be sufficient to support all 
projects which are formulated by the investigators, a systematic procedure 
is required to select projects that can be accommodated within available 
resources . 

With the notion that a systematic project selection procedure helps 
to visualize the expected payoff fcj the resources expended, the 
development nf a project selection model should incorporate three b^sic 
variables: (1) utility of a project, (2) uncertainty, and (3) constraints. 

Ut ili ty refers to a project's contribution to accomplishment of the 
raLSslon of the center. The utility is realized when a project is suc- 
cessfully completed. However, there is uncertainty Involved in project 
completion. In the case of R & D Centers, the uncertainty refers to the 
probability of successful completion of a project. 

Assuming that there are not enough resources to carry out all the 
projects, there is .a constraint that Is levied on the selection process. 
The constraint refers to the condition that the total required resources 
are within the total available resources. 

A project is carried out because it would yield a certeir amount 
of "return" at its termination. The return from a project is assumed 
equal to the utility of the project. However, the utility cannot be 
realized fully unless the project is completed successfully. Because 
of the uncertainty associated with successful completion, one can only 
estimate the "expected return" rather than Che actual return from a 
project at its termination. The expected return (R) Is, following 
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probability theory, a function of utility probability of successful 

t 

completicn. In mathematical notation the function can be described as 
follows : 




where 

= expected return '^om the i^^ project, 

= utility value of the i^^" project, and 

« probability of successful completion of the i^^ project. 

It is assumed the U, and F, are fixed for a given period of time. 

1 i 

In other words, during the decision-making period the values of utility 
and probability do not change. 

The actual decision-making problem is to select a set of projects 
from the total projects generated such that the cumulative expected 
returns from the selected projects is maximum. In other words, we have 
to select a combination of projects whose expected returns (R^)^ wh^n 
added would give a higher total of expected returns than any other com- 
bination of projects. This maximization problem can be formulated as: 



The expected return (R.) looks similar to Ward Edwards’ notion of 
subjective expected utility (SSU). However there are differences 
between R. and SEU. In SEH, the sum of probability varies across all 
outcomes is equal to one. In the project selection model, for each 
project the probability ranges f^*om 0 to 1. The SEU model allows selection 
of only one action from a list of possible actions. The project selection 
model does not plac.a a restriction on the number of projects which may be 
selected. There is also r.o resource constraint In the selection process of 
the SEU model. The project model takes into account the given resource 
constraint. 
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Maximize K 

A » Z (1) 

i»l 

where 

» expected return from che project, 

A a anticipated reward (cumulative expected return) , and 
N a number of selected projects. 

It can be seen that in order to maximize the anticipated reward, A, all 
generated projects have to be selected. That is, the highest anticipated 
reward can be obtained when all generated projects are carried out. 

However we know that all projects cannot be carried out because there are 
not enough resources to carry out all the generated projects. Actually, 
it is given that there is a limited resource available sufficient to 
accommodate only a subset of generated projects. The sel ction criteria 
should satisfy the resource constraint.. 

It costs a certain amount of resources to carry out a project. 

As stated earlier, the available resources limit the selection to a subset 
of projects. The resource constraint is such that the would-be alloted 
resources to the selected projects should not exceed the available resource. 
Letting stand for a project’s cost and T for total available resources, 
the constraint can be stated as follows: 

N 

^C<T, (2) 

1-1 

whero , 

■ required resource for the 1^^ project, 

Z - total available resources, and 
K - number of selected projects. 
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Combining equations (1) and (2) t' e project selection problem can 
be formulated as follows: 

Maximize N 

A = £ (3) 

i-1 

such thav N 

Z C -IT. 
i=l ^ 

The problem is to find a value for N and to identify the projects, i. This 
is, the project selection problem is to find the subset of projects to be 
selected and alpo the content of the subset. Ihe problem can be solved by 
an iterative process or more precisely by the dynamic programming technique 
(Beckman, 1968). Forming the project selection problem as a knapsack 
problem in dynamic programming (Beckman, 1968), the dynamic programming 
method would give the number of projects the subset contains and the 
content of the set of the selected projects. The method would also indicate 
the anticipated reward for the total required resources. The variables that 
are used in the project selection model require numerical valuer. Procedures 
to estimate variable values are suggested in following section. 

Ks timati< in of Variable Values 

The project selection procedure requires that values be stated for 
project utility, probability of successful project completion, project 
cost, and total resources available. A project's utility represents the 
contribution that a project would make toward achieving the overall mission. 
The project utility value depends, th'irefore, on how crucial the project 
contribution is and how close it comes to achieving the mission. The 
project whose contribution is both significant in terms of achieving the 
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mission and also close to achieving It would have a high utility value. 
Closeness Is defined In ter^us of number of stages required in attaining 
the overall mission. For example, a project covering an objective of the 
first stage In the multl-transltlonal process Is closer to the mission 
than a project covering an objective of one of the later stages. 

In order to estimate the utility value, a procedure similar to 
computing a probability estimate following the Mark ov Chain process 
(Keuieny and Snell, 1960) can be adopted. For example, at each segment 
stage an arbitrary value of 1 can be distributed to goal areas. Indicating 
priority levels. Allocation of prlc;.lty can be based on some predetermined 
level of Importance. Another arbitrary value of 1 can be distributed to 
the objectives In a goal area. Such a procedure Is Illustrated In 
Figure A. 







.12 
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.10 

.045 

,135 
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Figure 4. Markov Chain Procedure to Compute Utility Scores 
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A project utility value can be obtained by multiplying the numerical 
values following along from the top of the Harkov chain tree to the 
appropriate objective. For example, the utility of the project dealing 
with objective 1 In Figure 4 Is * (.4) . (.3) .)2. The project 

utility of objective 3 Is ■ (.6) . (.3) . (.75) ■ .135. Allocation of 
priority values can be done by one man or by j panol of experts. When a 
panel of Judges Is used, the Delphi technique can prove very valuable. 
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The project statements supplied by the investigators can be used in 
ascertaining the probability of successful project completion. The 
probability is conceived in terms of the amount of risk Involved in 
attaining the stated objective in the project statement. Amount of risk 
is assumed to be a function of proposed methodology in the project statement. 
Investigator's ability and competency, and estimated time required for 
project completion. If the project statement offers ill-conceived 
methodology and Inadequate techniques of investigation, at the completion 
of the project it will fall to achieve the stated objective in the project 
statement. Sound methodology is useless unless the investigator possesses 
the abilities to put the method in operation. Thvs, not only sound 
methodology but als'' the ability and skill of the investigator teems to 
add to the quality of the project statement, A certain amount of time is 
required to complete a job. The time element refers to the months or 
years required to complete a project successfully. If the tine to 
complete a project is not properly estimated the probability time would be 
low. The time element is very Important, particularly in adopting the 
PERT or CPM techniques. 

An Instrument oan be i,»*apared covering all relevant technical aspects 
of a project statement to ascertain the probability of completion. The 
instrument can follow the rating scale format. A method of arriving at a 
num.'rlcal value for this probability needs investigation. 

Another variable that requires estimation is the project cost. The 
project statement indicates the amount of money that would be required 
to cany out the project. Other expenses such as salary for the 
investigator and overhead expenses can be added to the estimated project 
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cost, thus giving a gross estimation of project cost# The gross estimated 
cost (C^) can be used in the project selection procedure. 

The total resources available (T) , is ‘issumed as given for the 
decision-maker. The resource here means dollar amount. From normal 
accounting procedures and knowledge of available funds it is assumed that 
the user can calculate available dollar amounts for R & D purposes. 

A fundamental assumption in the Research & Development Planning 
System (RDPS) i? that all objectives which are developed using the multi- 
transitional process should be satlsfleu, l.e., projects covering all 
objectives should he completed to achieve the o^^erall mission. However, 
it may be true that all projects cannot be carried out at one time because 
of a resource constraint. After the projects initially selected are 
completed, the project selection model may then be applied to the 
remaining projects. When doing this, the utility values are recomputed 
with completed projects being assigned utility values of zero. This 
assumes, of course, that other resources have become a’ailable. 
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Implications of the RPPS 
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The project generation procedure can show programmatic thrust. 

After the projects are completod, the results can readily he Integrated 
and easily assimilated. By following the Ri^PS the centers can rationalize 
and justify the projects that the centers undertake. The RDPS also helps 
to evaluate the centers* progress, show the direction in which a center 
is moving, and in concentrating the R & D activities. 

The project selection model can serve as a tool in decision-making 
The educational centers are mostly supported by the USOE. The number of 
projects that a center can undertake depends on the size of the grant by 
the USOE. Whenever the decis lon-aiaker suspects that the size of the grant 
may change, he has to make decisions on what projects to undertake and what 
not to undertake. The project selection model can ease some of his worries. 
The decision-maker can manipulate the model by changing the total money 
level, T. He can evaluate the project itentials at different levels. 
Accordingly, he can select projects within the available money. It should 
be remembered that the project selection model does not replace the 
declslon-oiaker . The model simply serves as a guideline In making decisions. 
The project selection model by no means determines the final decision. 

Conclusions 

The planning system that Is proposed In this study appears to have 
Intuitive validity. Implementation of the system proposed In this paper 
would help to alleviate the present diffuse project selection situation 
by leading the educational R & D centers to more rigorous project selection 
and concentrated and coordinated research and development activities. 
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The intentions of the educational R & D centers > according to 
Boyan and Mason (1968) » require the management ability ai\d the organi- 
zational desire to marshall extraordinary human and financial resources 
into well-designed sets of continuous and cumulative programmatic 
activities. The planning system developed In this study would seem 
to support these Intentions. 
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